12/16/05 FRI 10:40 FAX 1 612 305 1228 MUETING & RAASCH 



©014 



Amendment and Response Page 1 1 of 18 

Serial No.: 10/034,696 
Confirmation No.: 1502 
Filed: December 27. 2001 

For: SURVEILLANCE SYSTEM AND METHODS REGARDING SAME . 

Remarks 

The Final Office Action mailed 22 July 2005, and also the Advisory Action mailed 18 
October 2005 have been received and reviewed. Claims ] , 13, 24, 3 1 , and 38 have been 
amended. Claims 2 and 16 have been cancelled. It is further noted that claims 3, 7, 11, 14, 18, 
22, 25, and 32 have previously been cancelled and not withdrawn as shown in the Final Office 
Action Summary. Therefore, the pending claims are claims 1, 4-6, 8-10, 12-13, 15, 17, 19-21, 
23-24, 26-31, and 33-43. Reconsideration and withdrawal of the rejections are respectfully 
requested in view of the amendments and remarks provided herein. 

Advisory Action 

The allegations by the Examiner in the Advisory Action are noted. Applicants traverse 
such allegations. However, to move this case to issuance, Applicant has amended the claims to 
clearly distinguish the present invention from the art cited, even though it is believed that 
previous arguments provided are believed to be effective in overcoming the Examiner's 
rejections. 

Claim Objections 

In the Final Office Action, the Examiner objected to claim 2 under 37 C.F.R. § 1.75(a) as 
failing to particularly point out and distinctly claim the subject matter which the applicant 
regards as his invention or discovery. Claim 2 has been cancelled. Therefore, such objection to 
claim 2 is moot. 

The 35 U.S.C. §103 Rejection 

In the Final Office Action, the Examiner rejected claims 1-2, 4-6, 8-10, and 12-21 under 
35 U.S.C. §103(a) as being unpatentable over Uyttendaele (U.S. Patent No. 6,701,030) in view 
of Kanatani ("Optimal Homography Computation with a Reliability Measure", IAPR Workshop 
on Machine Vision Applications, Nov. 17-19, 1998) and Hansen (U.S. Patent No. 6,081,606). 

Further, it appears that claims 4-6, 8-10, 12, 15-17, 19, 21, 23, 26-30, 33-37, and 39-43 
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were rejected for the same reasons provided in the prior office action. In other words, it appears 
that clams 4-6, 8-10, 15-17, 19, 21, 26-28, and 33-35 are indicated by the Examiner to be 
rejected under 35 U.S.C. §1 03(a) as being unpatentable over Uyttendaele in view of Kanatani; 
and claims 23, 29-30, 36-37, and 42-43 are rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Uyttendaele in view of Kanatani as applied to claim 1 above, and further in 
view of Hansen (U.S. Patent No. 6,081,606). 

Yet further, it is unclear from the Final Office Action what the actual rejection is for 
claims 24 and 31, although it appears that Uyttendaele (U.S. Patent No. 6,701,030) alone has 
been applied to claim 24. Claim 31 has been rejected for the same reasons as 24. 

Sti ll further, claim 38 has been rejected for the same reasons as claim 1. In other words, 
claim 38 has been rejected under 35 U.S.C. §103(a) as being unpatentable over Uyttendaele in 
view of Kanatani and Hansen. 

Applicant urges the Examiner to clarify the claim rejections if the currently pending 
claims are not considered to be in allowable form. 

Applicant continues to respectfully traverse the rejections and believes that the previous 
remarks filed in response to the previous Office Actions are sufficient to overcome such 
rejections. As such, these previous remarks are incorporated by reference herein and the 
following additional remarks are provided. 

Please keep in mind that to establish a prima facie case of obviousness, three basic 
criteria must be met. First, there must be some suggestion or motivation, either in the references 
themselves or in the knowledge generally available to one of ordinary skill in the art, to modify 
the reference or to combine reference teachings. Second, there must be a reasonable expectation 
of success. Finally, the prior ait references must teach or suggest all the claim limitations. See 
MP.E.P. §2143. 

Prior art references do not teach or suggest all the claim limitations 

The Examiner continues to allege that "the panoramic image, i.e., the search area, is 
defined by two outer perimeters. In order for the six cameras (col. 7. lines 12-14 of Uyttendaele) 
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to be placed correctly their positioning ha$ to be defined by these omer perimeters or else the 
panoramic image will not look complete as some sections wil] end at higher locations than 
others." Even the language at column 6, lines 48-56 further cited by the Examiner defines a 
panoramic video as a 360 degree image. Applicant does not argue that Uyttendaele describes the 
image as being a $phere, although this does not appear to be entirely excluded. 

However, as set forth in the response to the Final Office Action, Uyttendaele describes 
the stitching of frames together to form a panoramic video (sec column 8, lines 8-27). As 
indicated at column 7, lines 9-21, the system uses six cameras mounted on six faces of a cube 
resulting in a 360 degree by 360 degree field of view. Overlap in field of view for the cameras is 
described as being at least 20 percent (see column 7, lines 41-52). The stitching together process 
utilized in Uyttendaele is described in U.S. Patent No. 6,018349, entitled "Patch Based 
Alignment Method and Apparatus For Construction of Image Mosaics" (see column 8 ? lines 8- 
27). The stitching process aligns the images using an incremental deformation of one image 
relative to a coordinate system and using a warping process described therein, 

Uyttendaele does not describe M an entire search area defined by an outer perimeter edge." 
At most, Uyttendaele describes a panoramic video provided using six cameras mounted on six 
faces of a cube resulting in a 360 degree by 360 degree field of view. Although the panoramic 
image (e.g., not the search area to be monitored) has multiple edges, there is no description in 
Uyttendaele of a search area having an outer perimeter edge (i.e., perimeter being a boundary 
enclosing an area) that is to be covered by a plurality of imaging devices. 

The Examiner alleges that Uyttendaele creates the panoramic image and there is an upper 
and lower perimeter edge as a panoramic image can be considered a ring, which has two edges. 
The Examiner further alleges that either of such edges could be the outer perimeter edge. 
However, perimeter refers to a boundary enclosing an area. In the present invention, the area is 
a search area to be covered by imaging devices. There cannot be multiple perimeter edges for 
the same area, as alleged by the examiner. Neither of the perimeter edges alleged by the 
Examiner form the boundary enclosing an area, yet alone enclosing a search area. Such edges 
set forth by the Examiner would not be considered a boundary enclosing a search area as a 
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panoramic view is an unobstructed view extending in al] 360 degree directions. Clearly, one of 
the edges does not provide a boundary commensurate to an outer perimeter edge of a search 
area. 

As clearly stated in response to the previous Office Action, the Examiner's application of 
such a contrived edge of Uyttendaele to define an alleged search area is inappropriate. The 
present invention is focused at monitoring a defined search area; the definition of the finite 
search area is bounded by an outer perimeter edge (e.g., about the perimeter of the search area, 
or, in other words, a boundary enclosing an area). Imaging devices then are located to provide 
coverage of the entire defined search area. Uyttendaele does not provide such a defined search 
area (i.e., a search area that is defined by an outer perimeter edge). 

The boundary of the defined search area according to the present invention is used to 
position the imaging devices. This is not the case in Uyttendaele as merely a complete ring of 
images to provide the 360 degree panoramic view (e.g., an unobstructed view extending in all 
directions) is desired. 

Kanatani, rather than defining a search area, focuses on developing the homography 
between two images and nothing more. Hansen et al., also cited by the Examiner, also does not 
describe positioning of a plurality of imaging devices to cover a search area defined by an outer 
perimeter edge. 

Still further, each of the independent claims (e.g., 1, 13, 24, 31, and 38) describes the use 
of a plurality of imaging devices to provide image data covering a defined search area. Each 
field of view of each imaging device includes a field of view portion which overlaps with at least 
one other field of view of another imaging device. Further, the claims set forth the selection and 
physical marking of the defined search area with a plurality of non-movable landmark points of 
commonality in field of view portions which overlap (e.g., points selected and physically marked 
on the non-movable ground during installation of the imaging devices as set forth on page 23, 
lines 9-18 of the pending application). 

The references also do not show such selection and physical marking as recited therein. 

As such, for at least the above reasons, the pending independent claims I, 13, 24, 31 and 
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38 are not anticipated by the cited references. 

Further, the remainder of the rejected claims (i.e., claims 4-6, 8-10, 12, 15, 17, 19-21, 23, 
26-30, 33-37, and 39-43) respectively depend on one of the independent claims, either directly or 
indirectly. Therefore, they include the limitations of the respective independent claim upon 
which they depend. As such, all the limitations of each and every claim are not taught or 
suggested in the cited references. Therefore, such claims are not obvious in view of the 
references cited. 

There is no suggestion or motivation to modi fy the reference or to combine reference 
teachings 

Regarding claims 1 and 13. and all claims depending thereon 
Uyttendaele is summarized above. Kanatani ("Optimal Hornography Computation with a 
Reliability Measure", IAPR Workshop on Machine Vision Applications, Nov. 17-19, 1998) 
describes an algorithm for optimally computing the hornography between two given sets of 
points on a plane. For example, the reference computes the hornography between two images 
(see page 428) (e.g., an image of a rectangular region and ten points in it and an image of the 
same region viewed from above). 

Providing a panoramic view is a much different imaging project than imaging a defined 
search area. Uyttendaele describes the stitching of frames together to form a panoramic video. 
The stitching together process of Uyttendaele aligns the images using an incremental 
deformation of one image relative to a coordinate system and using a warping process to 
combine the images. 

Hornography requires the identification of common points in the overlapping regions. 
Depending on the panoramic view being imaged (e.g., a sky portion that would be likely in an 
outdoor 360 degree panoramic view), it would be difficult to locate planar points in order to 
combine images using hornography as described in Kanatani (e.g., it would be difficult to find 
common points in a view that had little three dimensional characteristics associated therewith). 
With a defined search area to be monitored as described according to the present invention (i.e., 
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defined by an outer perimeter edge), physical locations for landmarks between fields of view can 
be employed to generate at least one homography transformation matrix. 

In other words, Uyttendaele would not be modified to use homography in the generation 
of a panoramic view, as in many cases as described above, homography would not work. "The 
mere fact that references can be combined or modified does not render the resultant combination 
obvious unless the prior art also suggest the desirability of the combination." (In re Mills, 916 
R2d 680, 16 USPQ2d 1430 (Fed. Cir. 1990). In the present case, modification is not suggested. 
In fact, such modification, at least in the generation of certain panoramic images, would result in 
Uyttendaele being unsatisfactory for generating such an image (e.g., when it is difficult to locate 
planar points in order to combine images using homography). "If proposed modification would 
render the prior an invention being modified unsatisfactory for its intended purpose, then there is 
no suggestion or motivation to make the proposed modification." (In re Gordon, 733 F.2d, 900, 
221 USPQ 1 125 (Fed. Cir. 1984). 

As such, there is no teaching or suggestion in the references cited to combine the 
references to obtain the invention of claims 1 and 13. Therefore, such claims are not obvious in 
view of the references cited. Further, all the claims that respectively depend on one of the 
independent claims 1 or 13, either directly or indirectly, include the limitations of the respective 
independent claim upon which they depend. As such, and as described above, such claims are 
not obvious in view of the cited references for at least the same reasons as the independent 
claims, and by reason of their own limitations. 

With respect to claims 24, 3 1. and 38. and all claims dep en ding thereon 

In Uyttendaele, a panoramic view is provided by positioning of imaging devices about a 
cube. There is no need or teaching to position imaging devices at multiple installation sites as 
only a 360 degree panoramic view is provided about one point (e.g., all cameras are provided 
about one point). "The mere fact that references can be combined or modified does not render 
the resultant combination obvious unless the prior art also suggest the desirability of the 
combination." (In re Milts, 916 F.2d 680, 16 USPQ2d 1430 (Fed. Cir. 1990). Positioning 
cameras at multiple sites in Uyttendaele would provide no discernible benefit to the generation 
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of a panoramic image. As such, there is no motivation to provide imaging devices at multiple 
installation sites therein. 

As such, for at least this reason, there is no teaching or suggestion in the references cited 
to combine the references to obtain the invention of claims 24, 31, and 38. Therefore, such 
claims are not obvious in view of the references cited. Further, claims depending on claims 24, 
31, and 38, either directly or indirectly, include the limitations of the respective independent 
claim upon which they depend. As such, and as described above, such claims are not obvious in 
view of cited references for at least the same reasons as the independent claims, and it is 
respectfully requested that the rejection of such claims be withdrawn. 
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Summary 

It is respectfully submitted that the pending claims are in condition for allowance and 
notification to that effect is respectfully requested. The Examiner is invited to contact 
Applicant's Representatives, at the below-Jisted telephone number, if it is believed that 
prosecution of this application may be assisted thereby. 



Respectfully submitted for 

PAVLIDIS 

By 

Mueting, Raasch & Gebhardt, PA. 
P.O. Box 581415 
Minneapolis, MN 55458-1415 
Phone: (612) 305-1220 
Facsimile: (612) 305-1228 
Customer Number 26813 



Date Mark J. Gebhardt ^ 



Reg. No. 35,518 

Direct Dial (612) 305-1216 



CERTIFICATE UNDER 37 CFR 31.8 : 

The undersigned hereby certifies that the Transmittal Letter and ihe paper(s), as described hereinabove, are being 
transmitted by facsimile in accordance with 37 CFR §1 .6(d) to the Patent and Trademark Office, addressed to Mail 
Stop RCE, Commissioner for Patents, P.O. Box 1450, Alexandria, VA 223 13-1450, 
on this 16? day of TSEC* . 2005, at I O'-HU (Central Time). 
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Name: 
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